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^ ' The feasibility of placing bounds on CPT violation from experiments 

Oj^ ' with neutral- -B mesons is examined. We consider situations with uncor- 

. related mesons and ones with either unboosted or boosted correlated 

! mesons. Analytical expressions valid for small T- and CPT-violating 

^ \ parameters are presented for time-dependent and time-integrated decay 

^ I rates, and various relevant asymmetries are derived. We use Monte- 

^ ' Carlo simulations to model experimental conditions for a plausible 

range of CPT-violating parameters. The treatment uses realistic data 
Qh! incorporating background effects, resolutions, and acceptances for typ- 

r-| ! ical detectors at LEP, CESR, and the future B factories. Presently, 

there are no bounds on CPT violation in the B system. We demon- 
strate that limits of order 10% on CPT violation can be obtained from 
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data already extant, and we determine the CPT reach attainable within 
the next few years. 
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I. Introduction 



With tlie advent of experiments capable of reconstructing relatively large numbers 
of decays of neutral B mesons, a new window has opened for high-precision tests 
using the interferometric nature of the neutral B system in analogy to the neutral- 
kaon system. A particularly interesting possibility is testing CPT invariance, which 
is believed to be a fundamental symmetry of local relativistic particle field theories 
|1|, 0, H, |, H, 1^, 1^ and therefore also of the standard model. The possibility that CPT 
invariance might be spontaneously violated in string theory at observable levels via a 
mechanism arising as an indirect effect of string nonlocality has been suggested in refs. 
P, 1^, [l^. CPT violation might also arise if quantum mechanics is modified by gravity, 
|TI|, |T2|, |T3|, including perhaps in the context of string theory with unconventional 
quantum mechanics . 

At present, the tightest bounds on CPT violation come from observations in the 



neutral- kaon system ||T5|, |T6|, |T^, |18|. However, experimental bounds could also be 
obtained using other neutral-meson systems. This possibility is of interest because the 
magnitudes of CPT violation could be different in the various systems. For example, 
in the string scenario with spontaneous CPT violation, effects of different magnitude 
could appear at levels accessible to future and perhaps even present experiments 



not only in the K system but also in the B and D systems ||T0|- It has recently 
been demonstrated that CPT signals can in principle be separated from other effects 
in the neutral-i? system using B factories |19[ and in the neutral-D system using 
both correlated and uncorrelated decays [^. These analyses were purely theoretical, 
disregarding background effects and detector acceptances. Otherwise, with a few 
notable exceptions pi], |22|, the issue of CPT violation in the B system has received 
relatively little attention in the literature. At present, there are no experimental 
limits on CPT violation in either the B or the D systems. 

Several types of experiments collecting B events are presently underway or under 
construction. Close to 10^ reconstructed uncorrelated B events are already available 
from each of the LEP collaborations at CERN pS). Large numbers of uncorrelated 



B events have also been collected at the Tevatron |24|. A symmetric B factory using 
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CESR at Cornell has produced relatively large numbers of correlated B^-B^ pairs 
from the decay of the T(4S') resonance, with about 2.6 x 10® reconstructed T(4S') 
decay events obtained in CLEO |^ . Asymmetric B factories, which generate boosted 
correlated B pairs, are under construction at SLAC and KEK. The corresponding 
detectors BaBar and BELLE should provide approximately 10^ reconstructed B pairs 
in a year at design luminosity 



In the present work, we investigate the practicability of extracting bounds on 
CPT violation from a variety of realistic experimental situations. We obtain analyt- 
ical expressions for time-dependent and time-integrated decay rates that hold under 
general circumstances for uncorrelated, correlated unboosted, and correlated boosted 
B mesons. In each case, we use Monte- Carlo simulations to provide a measure of the 
level at which CPT violation can be bounded. For definiteness, we perform simula- 



tions assuming a typical LEP detector (OPAL) at CERN the detector CLEO at 
CESR and the detector BaBar at SLAC 

Our basic notation and conventions are presented in Sec. II, along with an outline 
of the procedure we adopt for the Monte-Carlo simulations. We begin the detailed 
analysis in Sec. Ill, which treats the case of uncorrelated B mesons. The theory 
for this situation is in Sec. IIIA, while the experimental simulation involving the 
detector OPAL at CERN is in Sec. IIIB. Section IV discusses the case with correlated 
B mesons. The theoretical analysis is in Sec. IVA, and the experimental simulations 
for the unboosted (CLEO at CESR) and the boosted (BaBar at SLAC) situations 
are in Sees. IVB and IVC, respectively. Section V contains a summary. 

II. Preliminaries 

This section contains basic definitions underlying our analyses and an outline of 
our simulation procedures. Most of our conventions are related to canonical ones 



for the kaon system and are discussed in more detail in refs. fl^, |I9|. Our analysis 
assumes throughout that any CP violation is small, which implies small T and CPT 
violation, and it disregards terms that are higher-order in small quantities. 
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The effective hamiltonian for the B^-B^ system has eigenvectors given by 

\Bs) = [{l + eB + 6B)\B') + {l-eB-6B)m]/V2 , 

\Bl) = [{l + eB'SB)\B'')-{l-eB + 6B)m]/V2 . (1) 

The quantities and Sb are complex and parametrize CP violation. The former 
measures indirect T violation, while the latter measures indirect CPT violation. The 
analogous parameters ex and 6k for the K system are defined by Eq. (|l|) but with 
the replacement B K. 

The time evolution of the physical states Bs, Bl is governed by the corresponding 
eigenvalues of the effective hamiltonian: 

\Bs{t)) =exp{-imst--fst/2)\Bs) , = expHm^t - 7it/2)|5i) , (2) 

where the physical masses are ms, mi and the decay rates are 'js, 11- It is conve- 
nient to introduce definitions for certain frequently occurring combinations of these 
quantities. We set 

m = ms + mL , 7 = 75 + 7l , 

Am = mL-ms , A7 = 75 - 7^ , 

= Am^ + A7V4 , &^ = Am^ + 7^4 , 

2Am A7 
X = , y = . (3) 

7 7 



Experimental data are available for some of these quantities specifically for 
the B'^ meson PT|. The mass difference is lAm^l = (3.4 ± 0.3) x 10^^^ GeV, and the 



mean lifetime is f^o = (1.50 ±0.11) x 10"^^ s. These values determine the magnitude 
of the mixing parameter x as \xd\ > 0.71 ± 0.06. We introduce the inequality here to 
allow for nonzero CPT violation, which affects the standard analysis and increases 
the numerical value of \xd\- 

In contrast, no experimental limit exists on the scaled rate difference y. It is the- 
oretically plausible to take the magnitude of ?/ as \y\ ^ 0(10^^) ^ This estimate 
is based on the box diagram in perturbation theory, where the dominant interme- 
diate states are the top and charm quarks. It is likely to be a good approximation 
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since short-distance effects are larger than dispersive ones in the neutral-i? system. 
More details about this analysis and references to the literature can be found in, for 



example, the reviews p2|, 53, Rl, [35|]. 



For the purposes of the present work, we focus on two types of B^-decaj modes: 
the semileptonic modes D^*^^ with i being e or /i only, and the mode 

— s> J/ipKs- These are particularly attractive from the experimental viewpoint. In 
principle, our CPT analyses could be further enhanced by grouping together certain 
special B decays, called semileptonic-type decays |jl9|. These include the standard 
semileptonic decays above, together with a subset of other modes B^ ^ f for which 
there is no lowest-order weak process allowing a significant contamination of either 
B^ —>■ f OT B^ ^ f. Observed semileptonic-type decays include 5° D^Df, 
B° J/ipK+TT-, 5° ^ J/V^ir*°(892), 5° ^ V^(2^)i^*°(892), and similar decays 
into excited states. Observed modes other than those listed incorporate a CKM- 
suppressed process excluding them from the semileptonic-type class. The theoretical 
analyses in the present work are general enough to allow for this special grouping, 
but for simplicity we disregard it in our Monte-Carlo simulations. Incorporating it 
should result in some improvement over the bounds we obtain. 

The analyses in the sections below involve transition amplitudes for the decay 
into a final state /, taken to be either a semileptonic-type state or a J/ipK^ (or 
conjugate) state. Following standard procedure, we disregard possible effects from 
penguin diagrams or other loop contributions and parametrize these amplitudes as 
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{f\T\B') = Fjil^yj) , {f\T\BO)=XfFjil~yj) , 

{7\T\W) = F}{l + y}) , {f\T\B')=x}F]{l + y}) . (4) 

The independent complex quantities Xf, Xf, Fj, and yj are assumed small in what 
follows. Any possible violation of the AB = AQ rule is parametrized hj Xf and Xf, 
which both vanish if the rule is exact. Invariance under T implies Xf, Xf, Ff, and 
yf are real. Invariance under CPT imphes Xf = Xf and yj = 0. The quantity yf 
parametrizes direct CPT violation in the decay to /. 

Since the observed states are Bs and Bl, it is useful to obtain the associated 
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transition amplitudes analogous to those in Eq. (^). Combining the definitions (|l|), 
(^) and keeping only terms to first order in small quantities gives 

{f\T\Bs) = j^Fj{l + eB + SB-yf + Xf) , 

{f\T\BL) = j=,Fjil + eB-6B-yf-xj) , 

{f\T\Bs) = j^^F}il-eB-6B + y} + x}) , 

{f\T\BL) = -j=^F*il-eB + 5B + y}-x}) • (5) 

The theoretical analyses in the following sections incorporate the possibility of in- 
direct T and CPT violation through the parameters and 6b and allows for various 
sources of T and CPT violation through the parameters Ff,Xf,Xf, and yf. This level 
of generality has been kept for completeness. However, it is probable that some of 
these parameters are much smaller than others. For example, if CPT breaking does 
occur, general theoretical prejudice suggests that the magnitude of any indirect CPT 
violation is likely to be substantially larger than that of the direct CPT violation in 
any given channel. This is because 6b is an interferometric parameter, and more- 
over one that results from the combined effects over all channels of sources of CPT 
violation. These ideas are supported by analysis in the string scenario with sponta- 
neously broken CPT, where quantities such as Re?// are suppressed by many orders 
of magnitude relative to 6b |TI]]. Note that in the standard purely phenomeno logical 



description the parameters Re^s and Im^^ are undetermined and independent. In 
contrast, in the string scenario they are determined in terms of other quantities in 
the theory and are related through an additional constraint, 

xlm^B ± yRe^B = . (6) 

For generality, we do not impose this condition in what follows. 

A Monte-Carlo simulation of a realistic experimental situation allowing for the 
full parameter range of all the available T- and CPT-violating parameters produces 
unwieldy results. For the illustrative purposes of the present work, we have therefore 
chosen to restrict the multiplicity of available variables as much as possible compat- 
ible with our goal of demonstrating the feasibility of extracting CPT bounds from 
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realistic experimental data. In our simulations, we have taken advantage of the likely 
hierarchy in the magnitude of the various parameters, as described above, and have 
kept only quantities affecting indirect T and CPT violation. This restriction provides 
a meaningful approximation for extracting CPT bounds from experimental data. 

As described in the Introduction, the present work contains Monte-Carlo simula- 
tions of uncorrelated decays at a collider and of correlated decays at both symmetric 
and asymmetric B factories. We obtain four-vectors for B events from decays and 



T(4S') decays using the JETSET7.3 program that models jet fragmentation, par- 
ticle decays, and final-state parton showers. The full chain of detector simulation and 
event reconstruction is complex and unnecessary for our present purposes, so instead 
we statistically smear the four-vectors obtained from JETSET7.3 according to the 



energy and momentum resolutions outlined for the OPAL detector ||2^, the CLEOII 
detector [^, and the BaBar detector |2^. Detector geometric acceptances are in- 
corporated in all well as typical reconstruction efficiencies estimated from 
existing publications or projected values. The possibility of measurement of various 
asymmetries as a function of proper decay time is considered, and typical resolutions 
of decay lengths and i?°-meson boosts are taken for each of the detectors mentioned. 
Additional details of the simulations are described in the relevant sections below. 



III. Uncorrelated Systems 
A. Theory 

This subsection provides the theoretical derivation of time-dependent and time- 
integrated amplitudes and rates for relevant decays of uncorrelated neutral B mesons. 

We begin by considering decays into semileptonic-type final states /. Suppose an 
uncorrelated meson state \B^) is produced at time t = and evolves to the state \B{t)) 
after a time t measured in the rest frame of the meson. The analogous quantities for 
an antimeson are \B^) at t = and \B{t)) at time t. 

To obtain the time-dependent decay amplitudes, we proceed by inverting Eq. 
(|I|) to find the states \B^) and |-B°) and incorporating the time evolution via Eq. 
(0). Using Eq. (|p, some algebra then leads to the following time-dependent decay 
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probabilities: 



Pjit) 
Pj{t) 



Pf{t) ^ \{f\T\B{t))f 

= |l^/r((l + 4Re5B - 2Reyf + 2Rexf) exp{--fst) 
+ (1 - AReSs - 2Rcy/ - 2Rc,t/) cxp(-7Lt) 

+2[(1 - 2Rcyf) cosAmt - {4ImdB + 2lmxf) sin Amt] exp(-7t/2) 

\{7\T\Bm' 

PfiSe -Sb, Vf -Vf, Xf x}) , 

\{7\T\Bm' 

l\Ff\'^(^{l - iRecB + 2Reyf + 2Rexf) ex.p{--fst) 
+(1 - 4ReeB + 2Rey/ - 2Rex/) ex.p(--fLt) 
-2[(1 - 4ReeB + 2Rey/) cos Ami + 21m Xf sin Amt] exp(-7t/2) 
Pf{t) ^ \{f\T\Bm' 

= Pj{eB -eB, Vf -Vf, Xf x}) . (7) 



The decay probabilities Pj and Pf arc obtained by substituting as indicated in the 
expressions for Pf and Pj. These probabilities are used in subsection IIIB as input 
for our Monte-Carlo simulations. 

Intuition about the physical content of the decay probabilities can be obtained 
by considering the fully time-integrated rates and constructing various asymmetries. 
Explicitly, the time-integrated decay rates are: 



Rf ^ 



rOO 

/ dtp. 
Jo 



f 



1 1 

+ 



, l-2Reyf) 

2Ao' 4Am 

' (2Re5s + Rex/) p-(2Im5B + Imx/) 



ISlL 



Rt = 



Ri 



= / dtPj^ Rf{5B ^ -5B,yf ^ -yf,Xf ^x*f) , 

J 

f 

Jo 



dtP-7 



ISlL 



62 



(1 -4ReeB + 2Rey/) 
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2A7^ _ 4Am^ 

-Rexf Imx/ 



1s7l 



dtp 



f 



RjieB 



-^B,yf 



-yf,Xf Xf] 



Two interesting independent asymmetries can be defined from tliese rates. One is 
Rf - R-f 



Rf + Rj 
-2Reyf- 



1 



+2Am7572,(4Im5B + Im {xf + x/)) 



(9) 



Tfie otlier is 



A' = 



Ri 



Rj 



Rf + R-j 



4Rees — 2Re?// A76^Re (x/ — Xf 



70^ 



-2Am757iIm {xf + Xf] 



(10) 



Tfiese asymmetries provide insiglit about tlie information available from a complete 
analysis. As an example, in the case where r/f, Xf, and Xf are taken to be negligible, 
the first asymmetry gives information about indirect CPT violation while the second 
reduces to A'f = 4ReeB. 

We next consider decays into the final states of the form J/ ipK, which lie outside 
the semileptonic-type class. The physical final states involve the linear combinations 
Ks and Kl given by the kaon equivalent of Eq. (p. They are denoted by {J/ipKs\ 
and {J/iPKl\. 

The four possible time-dependent decay probabilities, 

Ps{t) ^ \{J/^PKs\T\Bm' 



(ReF 



J/4') 



+ 



(I - Ree^ + Re6B + l{Rexj/^ + Rexj/^)) exp(-7st) 

(Re ex + Rg^b + RgSk — RgSb 

-Reyj/^ - iRe (xj/^ - xj/^)) cos Amt 
— {ImeK — Ime^ + ImSx + Im^^ 
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+ |lm {xj/^ + xj/^) 



ImF 



ReF 



) sin Ami exp(— 7t/2) 



Ps{t) = \{Jl^Ks\T\Bm^ 

PL{t) = \{J/i^KL\T\Bm^ 

= (ReFj/^)^^(i - Ree^ - Re 5b - \{Rexj/^ + Rexj/^)) exp(-7Lt) 

+ (Re + Re — Re (^ii- + Re 5b 

-Reyj/^ + iRe (xj/^ - xj/^)) cosAmt 



+ (lmeK — Ime^ — Im^ft- — Im^s 



-ilm(xj/^ + xj/^) - 



ImF 



ReF 



sin Amt 



exp(-7t/2) 



= Pl{^k —^K, ^B — > —^B, 5k — —5k, 5b — > — 5_B, 

can be found by a procedure analogous to that yielding Eq. (|^). The above expressions 
for Ps and Ps are used as input to our Monte-Carlo simulations in subsection IIIB. 

As in the semileptonic-type case, insight can be obtained from the fully integrated 
rates. The four time-integrated rates corresponding to the above decay probabilities 
are 



f 

Jo 



dtp. 



{ReFj/.^y 



,f 1 



1 

75 



7 

262 



7 



62 

dtPs 
Rsi^K —^K, e_B 



, {ReeB -Re5B - hRexj/^) 

/\'ni, r 

Im - Im eB + Im + Im 5b + |lni (xj/^ + Xj/^) 



Re xj/^ + ^(Re ex + Re5K - Re t/j/^,) 



ImF 



ReF 



J/V 
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Rl 



f 

Jo 



dtPr 





1 


r 1 






1 


r 1 

— + 


7 ■ 


"2 


262. 


Am r 
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(Rees + Ret^B + |Rexj/^) 



7 



62 



Rea;j/^ + —{ReeK -ReSx - Reyj/i,) 



Im ex - Im - Im 6k - Im 5^ - ilm {xj/^ + Xj/^) 



ImF 



ReF 



Rl 



dtp. 



yj/i, -yj/^, xji^ ^ x*j/^, Fj/^ Fji^) . (12) 

The replacements indicated by a double-headed arrow involve parameter interchange 
rather than substitution. 

Two theoretically interesting asymmetries can be constructed from the above de- 
cay rates. One is 



A. = ^ 



R,q — Rc 



Rs + Rs 

= 2(1 - ^)Re {sb - 6b) + R-e {xj/^ - xj/^) - ^Re {tK + 6k - yj/^) 



262 
2Am75 / 



62 V 



21)2 X-J/W -^JIWJ ^2 

( Im - Im -\-Ith6k-\- Im 6b + |lm {xj/^ -\- Xj/^) 



ImF 



j/i> 



Re Fj/^ . 

The other is the analogous quantity for the decays involving Kl. 

^ _ Rl — Rl 

Rl + Rl 

= ^15(75 ^ 7i) ^K, cb e*B, 6k -6k, 6b -6*b, 



(13) 



xj/^i, -Xj/^, xj/^ -Xj/^p, Fj/^ Fj/^) . (14) 
Of these two asymmetries, only the one involving Ks is considered because detection 
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of the Kl is difficult with current experimental techniques. 



B. Experiment 

In this subsection, we describe the results of a Monte-Carlo simulation involving 
uncorrelated B decays observed by a typical detector at a high-energy collider. For 
definiteness, we use a detector simulation that smears four-vectors according to the 
resolutions for charged-track and neutral-energy measurements of the OPAL detec- 



tor at LEP. 

The JETSET7.3 |39] event generator is used to simulate both 5° signal events and 
background events from decays into light-quark pairs and into other B hadrons. 
As discussed in section II, we restrict the variables in our simulation to parameters 
controlling indirect T and indirect CPT violation. This simplifies many of the relevant 
equations in the previous subsection. The time- dependent mixing probabilities for the 
signal are sampled from the probability distributions given for fiO D^*Hv decays 
in Eq. (|^) and for B^ J/ipKs in Eq. ([TT|) . The decay length L is found from the 
magnitude of the generated momentum of the signal B^ meson. 

For B^ D^*Hv decays, a typical decay-length resolution ol = 200 /xm is taken 
40| . We assume the boost of the B^ could be estimated with techniques using scaled 



Dt momenta, producing a resultant fractional resolution apj^/ps = 0.11 Rather 



than reconstructing vertices with the smeared four-vectors, the reconstructed proper 
time t is simply smeared according to 

For the fully exclusive B^ J/ipKs decay, an estimated decay- length resolution 
of = 300 fim is used. The smeared decay length is ffist found, and the momentum 
reconstructed from the sum of the smeared four-vectors of the decay products is 
subsequently used to determine the proper decay time. 

We ffist discuss in detail our analysis of semileptonic decays. In this useful 
quantity for CPT studies is the time-dependent asymmetry of decay probabilities 
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given by 



Pj{t) + Pf{t) 

sin Ami 

~ 4Im5B-— — — . (16) 

(1 + cos Amt) 

In deriving this result, we have neglected direct CPT and AB = AQ violations and 
have approximated 75 ~ 7/,. The latter implies that A7 can be treated as small over 
the range of time scales considered. 

Another key quantity is the difference of time-dependent asymmetries of decay 
probabilities, given by 



D{f,t) ^ 



Pj{t)-Pj{t) Pf{t)-Pj{t) 
Pj{t) + Pf{t) Pf{t) + Pj{t) 

-4ReeB(l - cos Amt) + 4Im5B sin Amt , (17) 



where the same approximations have been made. 

To construct these asymmetries experimentally, the b flavor of the B meson at 
both the decay and the production times must be determined. The flavor at the 
decay time is tagged by the charge of the lepton. The flavor at the production time 
can be identified using a jet charge technique It is assumed that this method is 



incorrect 20% of the time PT| , This mistag probability, the proper time resolution 
discussed above, and the backgrounds to the signal all dilute the magnitude of the 
experimentally observed asymmetry. 

The expected levels of various backgrounds are estimated from previous experi- 
mental measurements of Arrid ETI, HI]. Approximately 20% of the selected sample 



can be expected to be combinatorial background without lifetime information, aris- 
ing from the primary vertex of the event. This fraction of events is folded in with a 
distribution in the proper decay time consistent with a gaussian distribution of width 
(Xt. About another 10% of the selected sample is expected to arise from other genuine 
S-hadron decays with lifetime information that are misidentified as B'^ D^*^ii'. 
The decay-time distribution of these events is taken to be an exponential consistent 
with the average _B-hadron lifetime |Q convoluted with a gaussian of width at, but 
without the mixing time dependence of Eq. (|^. 
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For a perfect detector and with the approximations we have made, the form of 
Eq. (|1^) contains a pole structure at cos Amt = — 1. The observed magnitude of this 
asymmetry would be sensitive to the precise knowledge of the detector resolution, 
mistag probabilities, and backgrounds. We therefore focus instead on the difference 
of asymmetries given in Eq. (|17|) as an experimental observable for the semileptonic 
case. 

To test the prospect for measuring or bounding Im^^ via semileptonic decays, we 
generated large Monte-Carlo samples of 10^ events each that included all the above 
effects for a range of values of Im^^. For definiteness in this and all other analyses 
described below [^, we set to the value = 0.045. For each sample, the 

difference in asymmetries of Eq. (|1^) was constructed. 

For Im^^ = 0, we then generated an ensemble of 200 datasets of Monte-Carlo 
events. Each such dataset contained 1500 D^*^ih' decays, a statistical sample 

that could possibly be reconstructed by combining the present data from all the 
LEP collaborations. For the observed D{f,t) distribution in each of these simulated 
datasets, we performed binned maximum-likelihood fits to the expected shape for 
a particular value of Im^^. This determined the average bound that could be set 
on lm6B- Subsequently, we repeated the same process for dataset ensembles with 
Im^B = 0.1 and Im^^ = 0.2. 

From the ensemble of 200 datasets for the semileptonic case that were generated 
using lm6B = 0, the average value of the 95%-confidence-level (C.L.) upper bound 
on IirSb that can be placed on a single dataset is Im^^ < 0.12. Figure 1 shows the 
result from a typical dataset that gives rise to this limit. For the dataset illustrated, 
the probability is 25% that the data are from a parent distribution with Im^^ = 0. 

Assuming indirect CPT violation indeed exists. Fig. 2 shows typical fits and preci- 
sions to simulated data generated with Im^^ = 0.10 and Im^^ = 0.20. In the samples 
indicated, the probabilities that the simulated datasets are from parent distributions 
with Im^B = are 0.5% and 0.1%, respectively. 

We next turn to an investigation of decays into J/ipKs- In this case, a useful 
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quantity is the time-dependent asymmetry of decay probabilities given by 

^ ' ' Ps{t) + Ps{t) 

^ 2ReeB — 2Re 6b — 2(Reex + Ree^ + Re^i^- — Re^^) cos Amt 

-|-2(Ime/i' — Ime^ + Im5/f + Im^e) sin Amt . (18) 

In deriving this expression, approximations similar to those in Eg .(1161) have been 
made. If Re (5b and Imds are to be bounded at levels greater than known limits on 
the other parameters, then this expression effectively reduces to 

A{J/ipKs,t)^-2Re6Bil-cosAmt)+2lmSBsmAmt . (19) 

We find that the small branching ratio for the hadronic decay J/ipKs and 

the relatively small reconstruction efficiency make it unlikely that current LEP data 
can bound CPT effects in this channel. As an example, ALEPH has a sample of 
only 4 events of this type among the 3 x 10^ decays used to measure the 
lifetime [|^. Samples of B^ J/ipKs in uncorrelated events collected by CDF 
at the Tevatron are larger, but still insufficient. However, there are more promising 
prospects for larger samples in approximately 1 fb~^ of data to be obtained after the 
Fermilab main injector begins operation. 

For illustrative purposes and using the asymmetry of Eq. ([T9|) as the experimental 
observable with = 0.045 as before. Fig. 3a shows the bound that could be placed on 
lm6B from samples of 500 reconstructed 5° J/ipKs decays including resolutions 
outlined previously. The background levels are much smaller since this channel is 
particularly clean. Even with these large samples, the limits at the 95% CL. are 
IuiSb < 0.22. Figure 3b shows the feasibility for a typical measurement of indirect 
CPT violation, assuming an even larger sample of 1500 reconstructed J /ipKs decays. 



IV. Correlated Systems 
A. Theory 

In this section, we summarize some key formulae for the situation where corre- 
lated pairs of neutral B mesons are produced. Since our Monte-Carlo simulations 
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neglect effects other than from indirect T and CPT violation, and since the general 
analysis is already available in the literature |T^, |T^, we restrict ourselves here to 
consideration only of those asymmetries directly useful for the simulations. A more 
complete theoretical analysis is given in refs. |1^, where the reader can also find 
additional details of some of the derivations below. For simplicity in what follows, we 
take the correlated mesons as B^-Bd pairs formed from the decay of the T(4S'). Much 
of the discussion can be extended to the case of Bg pairs, along the lines suggested in 



ref. flO 



We work in the rest frame of the T(4S') resonance, choosing to align the z- 
coordinate axis with the momenta of the B pair. Since the the T(4S') has J^*" = 1 , 
the initial state \i) of the i?-meson pair immediately following the decay is 

\i) = ^[|S5(2)5l(-z)) - \BLiz)Bsi-z))] , (20) 

where the argument (±z) indicates the direction of the momentum. To simplify 
notation, we label the two mesons by an index a = 1,2 and suppose they decay at 
times ta into final states |/q,). 

The amplitude .4.12(^1,^2) for the decay can be written in terms of the transition 
amplitudes aas = {fa\T\Bs), a^L = {fa\T\Bi) and their ratios r/^ = o^aL/o-aS- The 
result is 



Ai2{tiM) = 1 aisa25(?/2e"^^™^*^+'"^*'^"2(^^*^+^^*2) -r7ie-'('"^*^+'"^*^)"2(^^*i+^st2)^ 



(21) 

This expression is the basic input for the Monte-Carlo simulations in the next two 
subsections. 

The presence of two time variables implies the existence of several types of time- 
integrated rates. One useful case is obtained by integration over the linear combina- 
tion 

t = ti+t2 . (22) 

This produces a rate dependent only on the time difference, which reduces some 
experimental systematics. Thus, integrating over t with At fixed yields the once- 
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integrated rate 
/(/i,/2,At) 



|>00 

^ J\At\ 



l\At\ 

|QlLa25'|^ ^-^|At|/2 



27 



-2Rer2i cos Am At — 2Iinr2i sin Am At ,(23) 



where r2i = V^/vi- 

Other useful once-integrated rates are produced by integrating over the orthogonal 
linear combination 

At^t2- ti (24) 

with t held fixed. The natural possibilities are: 

rt 



J{fl,f2,t) = \ J_^dAt \Al2itl,t2) 



1 
A7 



;i + |r2ir)(e^^*/^-e-^^*/2) 



2Rer2i . 

sm 



Am 



Amt] , 



(25) 



J+(/i,/2,i) = i fdAt 1^12(^1,^2)1 



- 1 



^ _ g-A7t/2 _ , ^ ,2 ^ , ^ ,2gAW2^ 



1 



Am 



(Rer2i sin Ami + Imr2i(l — cos Ami)) ,(26) 



-e-^*J+(/i,/2,-t) 



(27) 



These two once-integrated rates are used for the simulations in the next two subsec- 
tions. 

Integration over the remaining variable to produce twice-integrated rates inde- 
pendent of the times ti and ^2 can be performed with several different integration 
limits. If the range is complete, this procedure produces the fully time-integrated 
rate r(/i,/2) for the double-meson decay into final states /i and /2. However, it is 
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useful to introduce also the partial rates r"'"(/i, for which the decay into /i occurs 
first and r~(/i, for which it occurs second. This yields the expressions 



/oo 
dAt /(/i,/2,At) 
-oo 



' — oo 
1 



|0.15O2l| + |fllL02S'| 



r+(/i,/2) 



roo 

/ dAtI{fuf2,At) 
Jo 



ISlL 
62 



(hs(hL(^iLa2S + c.c, 



1 

27 



|Oi502L| 



+ 



|QilQ25'| 

75 



' '^IS'^2L'^IL0'2S 

' ^7 — iAm 



+ C.C. 



r-(/i,/2) = / rfAt/(A,/2,At) = r+(/i,/2) 

— oo 



(2^ 



Given these integrated rates, we can form asymmetries containing the essential 
information. An asymmetry useful for extracting the T- violation parameter Ree^ is 

r(/,/)-r(7J) 



^tot 



4Re {tB - Vf) 



(29) 



r(/,/) + r(/,/) 

We remark in passing that the incorporation of inclusive rates permits the extraction 
of the T-violation parameter Ree^ independently of Rey/ ]TP |. 

To obtain the real part of 6b, which parametrizes indirect CPT violation, it is 
useful to consider double-meson decays into a semileptonic-type state / in one channel 
and into JjipKs in the second. We disregard decays into J/ipKi in what follows 
because they are difficult to observe experimentally. The relevant ratio of matrix 
elements is 

{J/^Ks\T\Bl) 



VJ/ipKs 



{J/^Ks\T\Bs) 
Gk + f^B + - Sb 



ImF 



(30) 



Here, the quantities ex and Sk are measures of indirect T and CPT violation in the 
kaon-system, analogous to and 6b in the B system. We have assumed that ImFj/^ 
is a small quantity, which is reasonable since it governs direct T violation. This ratio 
of matrix elements enters the rate asymmetry useful for the extraction of the real 
part of 6b, which is 

Tif,J/^Ks)-T(f,J/^l;Ks) 



A 



f,K3 



T{f,J/^pKs) + Tif,J/^Ks 
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= 2Re{eB - Vf - 6b) -'^^^^j^'ReVJ/^Ks ■ (31) 

The above formula assumes that Xf = Xf and xj/^ = xj/^, i.e., that violations of the 
AB = AQ rule are independent of violations of CPT invariance. The kaon-system 
parameters and are of order 10"^ or less, so this latter asymmetry provides a 
means of limiting or measuring Re 5^ at levels larger than this, under the assumption 
of negligible direct CPT violation. 

Once Re 6b is known, the extraction of the imaginary part of 6b can be performed 
using another asymmetry involving double semileptonic decay, given by 

_ ^ r+(/,7)-r-(/,/) ^ b'A^Re6B + 2Am^slLlm6B , . 

r+(/,/) + r-(/,/) i{h^ + isiL) ■ ^ ^ 

In this case, the derivation assumes Xf = x*j, i.e., that any violation of AB = AQ is 
independent of CP violation. 

B. Experiment: unboosted case 

In this subsection, we describe the results of a Monte-Carlo simulation involving 
correlated B decays observed by a detector at a symmetric B factory, where the 
energies of the colliding electron and positron beams are equal. For definiteness, 
we use a detector simulation equivalent to the performance of the upgraded CLEO 
experiment at CESR, for which luminosity upgrades should allow the collection of 
large samples of data comparable in size and rate to those accumulated by the B 
factories at SLAC and KEK. 

Four-vectors are smeared as described in the previous section, except that we 
use appropriate resolutions for charged-track and neutral-energy measurements for 



the CLEO II detector |2^. A decay- length resolution of ai = 150 nm is taken for 
the reconstruction of vertices from both B^ D^*^^ decays and B^ J/tpKs de- 
cays. Difficulties with the time resolution can immediately be anticipated since the 
B^ mesons are produced almost at rest, which leads to short average decay lengths. 
Simulations confirm that measuring the time dependence of the decay-time asymme- 



tries is infeasible using either the CLEO II detector or even the future CLEO III |^| 
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detector. Indeed, the planned silicon-microvertex detectors for CLEO will primarily 
be used for background rejection rather than for the measurement of lifetimes. 

Despite these difficulties, total-rate asymmetries can still be considered. Note, 
for example, that the T- violation parameter €3 can be measured using the asymme- 
try of Eq. p9|). More relevant for our present purposes is that the time-integrated 
asymmetry presented in Eq. (^) can be used at a symmetric B factory to extract 
Re 6b- 

For our simulations, we take typical CLEO reconstruction efficiencies and back- 
grounds for the decay B° D^*Hv (see refs. [||]) and 5° J/iiKs (see ref. |^ ). 
With an integrated luminosity of 100 fb~^ equivalent to about 54 million correlated 
B^-B^ events, we estimate reconstruction is possible for approximately 3200 signal 
events in which one B'^ meson decays into D^*Hiy while the other decays into J/ipKs- 
The sign of the electric charge of the lepton in the semileptonic decay can be used to 
determine whether an / or / state is present. 

As discussed in section II, we restrict the variables in our simulation to parameters 
controlling indirect T and indirect CPT violation. Taking €3 = 0.045 as before, the 
asymmetry of Eq. (^) can be used to set an estimated limit of Re^^ < 0.03 at the 
95% CL. Present integrated luminosities at CLEO of about 2.0 fb~^ would give weak 
bounds Reds < 0.35. 



C. Experiment: boosted case 

More confidence in the limits or measurements of 6b obtained through its effects 
on the observed time evolution of the correlated B system can be obtained in asym- 
metric machines presently under construction. The planned B factories at SLAC 
and KEK will collide e"*" and e~ at different energies. The result is a moving T(4S') 
that subsequently decays into B^B^. Each 5° then eventually decays, producing a 
secondary vertex that can be reconstructed. 

Since both B mesons are boosted along the beam direction and have little trans- 
verse momentum, the difference in decay points is primarily along the beam or z 
direction. For a 9 GeV e~ beam colliding with a 3.1 GeV e"*" beam as being planned 
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for the B factory at SLAC, the average separation in z between the two decay vertices 
is approximately 200 /im. With a sufficiently sophisticated vertex detector, precisions 
can be attained allowing the measurement of the time evolution of the B^-B^ system. 
The goal of the B factory is to measure the time- dependent asymmetry in decays to 
CP eigenstates, but the effects of CPT violation can also be elucidated. 

Here, we describe the results of a Monte-Carlo simulation involving correlated B 
decays observed by a representative detector at a typical asymmetric B factory. For 
definiteness, we use a detector simulation approximating the future BaBar detector 
p9| at SLAC. With minor changes, our results should also be valid for the BELLE ex- 
periment at KEK. As before, we restrict the variables in our simulation to parameters 
controlling indirect T and indirect CPT violation. 

We again employ smeared four-vectors for these simulations. The correlated decay 
times ti and t2 are sampled according to the relations given in Eq. (pT]), (^3]), and 
(^). From the generated momentum of each signal B^ meson, two decay lengths Li 
and L2 are found. We assume a typical decay-length resolution of ai = 60 /xm [p9| . 
The proper decay times ti and t2 are then extracted for the Bs and Bl decay via 
the experimentally accessible channels 5° D^*Hu and/or B^ J/-ipKs, using the 
techniques described in Section IlIB. 

We consider first the case where both B mesons decay semileptonically into D^*^ii'. 
The following two useful t- or At-dependent asymmetries of once-integrated decay 
probabilities can be obtained: 

A{fJ,At) E 



and 

A{fJ,t) 





HAt|) -/(/,/, 


-|At|) 


/(/,/,- 


HAt|) + /(/,/, 


-|At|) 



sin Ami 

4Im5ij— — — - , (33) 

(1 -|- cos Ami) 



J+ifJ,t)~J^ifJ,t) 



J+ifJ,t) + J+{fJ,t) 

AT e (1- COS Ami) 

~ 4Im5ij— ^ : — —-- . (34) 

( Amt + sm Amt) ^ ' 

In these equations, direct CPT and Ai? = AQ violations have been neglected, and 

A7t and lV)At have been treated as small. The latter holds over the time scales 
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considered and is justified because the lifetime-difference parameter y is small. 

For a perfect detector and with the approximations made, Eq. (^) contains a 
pole structure at cosAmt = —1. This suggests the measured magnitude of the 
asymmetry is sensitive to precise details of the detector resolution and backgrounds. 
For this reason, we consider only the asymmetry as an experimental observable 
for the double-semileptonic case. 

The / and / states are identified from the sign of the electric charge of the lep- 
ton in each semileptonic decay. No dilution of the asymmetry is incurred through 
flavor mistagging. We take background levels and reconstruction efficiencies from 
prior works |^8|. With an integrated luminosity of 100 fb^^, we expect a sample 
size of about 2000 reconstructed correlated events with both mesons decaying 
semileptonically. 

To examine the feasibility of measuring or bounding Im^^ using the double- 
semileptonic channel, we followed a Monte-Carlo procedure similar to that used in 
Sec. IIIB. Setting = 0.045 and for a range of values of Im^^, we produced large 
samples of 10^ events incorporating the above experimental effects. We then obtained 
the asymmetry of Eq. (^) for each sample, allowing for effects due to decay-time res- 
olution resulting in incorrect determination of which B meson decayed first. 

Assuming first that Im^^ = 0, we created an ensemble of 200 datasets of Monte- 
Carlo events, each containing 2000 decays. For the observed A{f, /, t) distribution in 
each case, we then performed binned maximum-likelihood fits to the expected shape 
for a given value of Im^^- We thereby obtained an average bound that can be set on 
Im 5b- 

From the ensemble of 200 datasets that were generated using Im^^ = 0, the 
average value of the upper bound on Im^^ that can be placed at the 95% C.L. on 
a single dataset is Im^^ < 0.08. Figure 4 shows a typical dataset that gives rise to 
this limit. For the dataset illustrated, the probability is 86% that the data are from 
a parent distribution with Im^^ = 0. 

Next, we address the more interesting case for which one B meson decays semilep- 
tonically while the other decays into J/ipKs- This is one of the most attractive 
S-factory channels to determine the angle j3 in the Cabibbo-Kobayashi-Maskawa tri- 
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angle, using an asymmetry arising between events where the semileptonically tagged 
B meson decays first and those where the decay into J/ipKs occurs first [Q. The 
exclusive J/ipKs decay allows for full reconstruction of the B momentum. 
For this situation, we can examine two useful asymmetries: 

/(/, J/i:Ks, At) - /(/, J/ijKs, At) 



A{fJ,J/iljKs,At) 



and 

A{fJ,J/i;Ks,t) 



/(/, J/^Ks, At) + /(/, J/^pKs, At) 
2Rees - 2Re 6b 

— 2(Reei^ + Ree^ + ReSx — Re^^) cos Amt 

+2(lmeK — Ime^ + Im5;^ + Im^^) sin Ami ,(35) 



Jif,J/i;Ks,t)-Jif_,J/^/jKs,t) 
Jif,J/^Ks,t) + Jif,J/^Ks,t) 
2Re ee -2Re 6b 

sill /VtT?//! 

-2(Reei^ + ReeB + Re(5i^-Re(5B)— . (36) 

Amt 



In our experimental simulations, we use the asymmetry (|36| ) because it allows a study 
of Re 5b independent of Im^^- 

The procedure we follow is similar to that for the double-semileptonic case. Here, 
an integrated luminosity of 100 fb~^ should result in 2300 reconstructed tagged 
events [^. The results of our simulations are illustrated in Fig. 5. If Re^^ = 0, 
an average limit of Reds < 0.035 at the 95% CL. can be obtained with a data 
sample of this size, as is shown in Fig. 5a. Under the assumption that indirect CPT 
violation with Re^^ = 0.20 indeed exists, a typical fit and the associated precisions 
are illustrated in Fig. 5b. In the sample indicated, the probability that the simulated 
dataset is from a parent distribution with Re^^ = is less than 0.05%. It may be 
possible to attain even better sensitivity by fitting simultaneously to the asymmetry 
(p5|) or by performing a full two-dimensional fit to the distributions in ti and t2- 

V. Summary 

In this paper, we have examined the feasibility of bounding CPT violation in the 
neutral- i? system. The type of violation allowed might occur in a string scenario 
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within the context of conventional quantum mechanics. Our analysis includes the 
cases where the mesons are uncorrelated and those where the mesons are correlated 
and either unboosted or boosted. 

On the purely theoretical side, we have provided analytical expressions for both 
time-dependent and time-integrated decay rates for all these cases, allowing for di- 
rect and indirect T and CPT violation. Asymmetries are defined that permit the 
extraction of the parameters for indirect CPT violation. To address the issue of ex- 
perimental testing of these effects, we have performed Monte-Carlo simulations to 
model various plausible experimental situations. Both data already taken and data 
likely to be available within a few years are considered. Our treatment incorporates 
background effects and acceptances appropriate for the detectors OPAL at CERN, 
CLEO at CESR, and BaBar at SLAC. 

At present, no bounds exist on CPT violation in the B system. Our analysis 
suggests that under reasonable assumptions and with data already available a bound 
of order 10% can be placed on CPT-violation parameter 6b- Our simulations also 
suggest that the CPT reach of planned experiments is likely to attain the level of a 
few percent within the near future. 

Given the role of CPT invariance as a fundamental symmetry of the standard 
model, testing it is vital. If CPT violation were discovered, it could provide a test 
of string theory and in any event would have far-reaching implications for our under- 
standing of nature. 
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FIGURE CAPTIONS 



Figure 1. Simulated data and bound for the uncorrelated case in the semileptonic 
channel. The points with error bars represent the typical observed difference of asym- 
metries D{f,t) as a function of time for 1500 D^*Hu decays generated in a 
Monte-Carlo simulation with ImSs = 0. Superimposed as a solid line is the pre- 
dicted shape of D{f,t) for Im^^ = 0.12, which for this sample is the upper bound at 
the 95% C.L. determined from the difference of likelihood in binned likelihood fits. 

Figure 2. Simulated data and fits for the uncorrelated case in the semileptonic channel 
for (a) IjhSb = 0.1, (b) Im^s — 0.2. In each plot, the points with error bars represent 
the typical observed difference of asymmetries D{f,t) as a function of time for 1500 
— > D'^*^^ decays generated in a Monte-Carlo simulation with the indicated value 
of Im^B. Superimposed as sohd lines are the predicted shapes of D{f, t) found from 
binned likehhood fits. The fit results and associated precisions are also indicated. 

Figure 3. Simulated data for the uncorrelated case in the J/t/jKs channel. 

(a) The points with error bars represent the typical observed asymmetry A{J/%l)Ks) as 
a function of time for 500 B^ — > J/t/;Ks decays generated in a Monte-Carlo simulation 
with Im^B = 0. Superimposed as a solid line is the predicted shape for ImSs — 0.22, 
which for this sample is the upper bound at the 95% C.L. determined from the 
difference of likelihood in binned likelihood fits. 

(b) Same but for 1500 B^ J/t/jKs decays generated in a Monte-Carlo simulation 
with IirSb — 0.2. The sohd fine is the predicted shape. The fit result and associated 
precisions are also indicated. 

Figure 4. Simulated data and bound in the double-semileptonic channel at an asym- 
metric B factory. Points with error bars represent the typical asymmetry A{f,f,t) 
as a function of total time t obtained in a Monte-Carlo simulation with Im^^ = 
using 2000 correlated B^B^ decays with both mesons decaying into D'^*^£iy. Super- 
imposed as a solid line is the predicted shape of A{f,f,t) for Im^^ = 0.08, which 
for this sample is the upper bound at the 95% C.L. determined from the difference 
of likelihood in binned likelihood fits. 
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Figure 5. Simulated data for the semileptonic- J/'^i^^g channel at an asymmetric B 
factory. 

(a) Points with error bars represent the typical asymmetry A{f,f,J/ipKs,t) as a 
function of total time t for a set of 2300 S° J/ij^Ks, W D^*Hv correlated 
decays generated in a Monte-Carlo simulation with Re (5b = 0. Superimposed as 
a solid hne is the predicted shape for Re^^ = 0.035, which for this sample is the 
upper bound at the 95% C.L. determined from the difference of hkelihood in binned 
hkelihood fits. 

(b) Same but for 2300 events generated in a Monte-Carlo simulation with Y{b5b — 0.2. 
The solid line is the predicted shape. The fit result and associated precisions are also 
indicated. 
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